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In re Application of 

Jae Shin YU, Sung Bae JUN and Kyoung Ro YOON 
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Filed: March 7, 2002 

For: METHOD FOR GENERATING SYNTHETIC KEY FRAME BASED 
UPON VIDEO TEXT 

TRANSMITTAL OF CERTIFIED PRIORITY DOCUMENT 

Assistant Commissioner of Patents 
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Sir: 

At the time the above application was filed, priority was claimed based on the 
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This is to certify that the following application annexed hereto 
is a true copy from the records of the Korean Intellectual 
Property Office. 
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1020010012184 #^ <i3*}: 2001/12/13 

[AS*] 

^ t^^r tfl-g- 7la> ^BlDlc]cH 3^ ^eR-^i (brows ing)^r ^^n] 
t^^r *}t)SL -S-^^- ti-^-f^^- i^H ^ W]^^ UJ^E ^1 

^, al^^. iS^ofl ^fl*}^ a'iE cgo^ z)-z]-o) ajAE 

cg^o]] 7>#^# ^#=1 cgctfcq £171 , ifl^E cg^o]]^o) 

^-g- ajiM ^.^o^ 3 . 7 ] ) ifl^E cg^cq c^^^efloi ^l^Al^Voji al^]*H 

A>o]^ ^JL, ol <5>i-f°l olnl^ofl ^ ^^M: «1 

— — ^ 71 =5ll<a ^llsfe ^J^- ©j^S tJ-^ 71 Sell<y 

H 6 

^Elniclol, 7lsell<y 
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Hl^iS. «?^JE ^ 7l {METHOD FOR DETECTING CAPTION 
SYNTHETIC KEY FRAME IN VIDEO STREAM} 

^iL<^ ^11- M-E^^fl 
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1020010012184 #^ 2001/12/13 

<9> ^r^^r vfl-§- 7l«> ^E]nl^ol u. e^-f^l (browsing)^: W 

^ al^E cgcdofl C}]«V ^IL51 7>#^11- ^#5} Efl^E ojo^j ^-t^o}, # 7 ] 
7}^*1# 71^5. *H #7l @|AE ^'ilf ^^jI, #7l ^ 

<11> #4*>7fl^r yl^^. il^ Jl*^ ti^-f^* ^ 

y o Vl ?Hl 3^3.^, al^^l^i @)i!7} H]cl^. ^E^ofl cfl^fl, zj# 

€ ZJ-zJ-SJ eji^h ^«oll rfl^V 7}^ ^11- Zj#s} fJ^E ojoj|c>} 37 ] > al 

Bj^Eo] Afol^s. ^JI, o} cgc^^ ^q.^ oln^ofl ^ «H 
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1020010012184 #^ ^*>: 2001/12/13 

*]t)SL ^?># ^'il ^ n ^efl^JLS tflSSRr 3 * 

<i2> c^ig alcl^. 7l^^l oici^/w]tq^/^.c]^. o]ai 7l#^l 

*H ^V^m^r €*Rr €*Kr ^l*Rr ^^-t- 3^ 

( sear ching/fi Iter ing)s}jz. JieH-^l (browsing) lb ^^^f. 

<13> yj^tg^o] a]Ti|^ ^-^1^ ti. (non-linear video content browsing)-^ 

7H> 7l^-ol 7l#^ ^ ^ (shot segmentation) 7l^u2f av 

#e^E^(shot clustering) 71^0]^, ^ 7r *l 7l-££ ^e^c^ H^Ef 
^^AS -g^Rr^l *1<^1 7H> ^Alol 7]^o]tq-. 

<14> iiofl alrl^. ae^o] ^is] ^tfl^cf. 

<15> AlTi^jo] -^^^-i: 7>^1 ti]r^^ iS^ (Video Stream)^ £1-4 ^ =^2i 

^ ^(Structural information^]- ^^tr^f. t>1^.2- il^A 

^(genreHl ^ ^^(hierarchical structure)*- 7H^ ^^f. ^, 

tiltq^. iS^^- ^e)^<?l ^ 7fl5] ^(Scene)-^-S. M-^fH ^ 

o. cf^s] A^ja (Sub-Scene) S^r 4KShot)«3. fl°]H.^ 
^ ^tfls 7>^1^. wlrq^. il^i AtolB}- aj-sfl 

(interruption) 7>^1&1-S.^-E^ °io]*\ v]v]SL Hell^l-S] a]^ 

(sequence of frames)!- ^"ltfCf. tfl^-g-^ ^^tH ojon^ A^ai^ 
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1020010012184 2001/12/13 

<ie> <go]}*\ «>^°1 ^ ^ (analysis)^ 14 ^ 

(construction)^ 7}# 71-g-o] 5]^ #$Ht}.. •g^^.S «l^i<^ 

S}^ ^nl^oi ^ iio] ( SC ene)£: °l°)7l #7fl w]r]^. ^ofl £<>H 

cf. 7 }^9\ b)v]Sl 7)^ *]t\SLm ^2^-^ ^ «l-g- 3# 

^(key frame)** tfls^ja 3tr 

<17> O]^. ^C] ) JL^^O] Qtf^ H.e}-f Wltqo. ^EeJoflAi 

fi)Dl^ Jt^Kf ^ ^^o]i4 o>ol^ A ).b)-o} 03^ eg 

<3 -§"§- ^#*>7l ^^7> *l«8 ^ol^, o^tb 71 41 

71 S3j<y^ ^#*r^r ^7H5]^Cf. ^ 71 feSl^ ^ 

^fil ^S^fil ^-§-i: At 71 £5)1°^ ol^>c^ 

^*Kr 7l^olcf. tg-Aj 71 xr 31 01-2. cl-g-^-O.^ tq^eflol ^7Yo\] 

^ ^J±«- 3.^ ^ 9X3-, Td^l^fil ^ vfl-g-^ m>eji ^ Tfl 

°l*fl« ^ ii^. ^ *r 5W. 

<18> 7l^fil ^ 71 SSll^ofl ^ 7l#-B- til^i ^-^Mfil ^ 71 

aioll} 71 ^1AE| ol-g-^H *}^$\ 71 ^ell^^S ^, °1 ^ 71 =Efl 

°J* °l-§-^ ^ «*Rr ^r^AS °l-g-*Rr 3HI ^ ^Jol4. 

<19> ol ^oflA-1 til^l o. Qj^e^ ^a>^^-S ^ ^o. Qj h.«.o] 14] .§--§- 

XL^Sfl ^ 7Mi 0171 uflo.^1 A>^>ofl7fl ^H^l tfl^ Jl^ ^iil- 
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1020010012184 ^ <*}*}: 2001/12/13 

^"<HH1 tfl* ^313*1 ^l^l ££4. zj*^ eit ctf 

ol -§-<?}- ^ *r ^ E J)^ 

— ^.^iS. #-3.*! Qj^S. <3^<?1*1* ^^-JI o]^- o]^*! h o >^ 

<20> ^aflA^ *}v)o_ 3.^1 E 6)) ^fl<5>^ AA^\ ^iEt ^>^^S 

^#§>Jl, zj- <g*j6fl tfl^H ^-2.51 (Weight)!- ^^"M °1«- 

s. tM3*>^- ^ 71 ^1-a *fl ^>W. ^ofl aji 

<21> £ t^OfHfe 7}^9\ ^ 71 5.511 ^)1 olsqxl o>o_ ^ae ^ 7 ) 

<22> al^ QjAEH alcl^. a^iE ^ ^^i-ofl ^^fl^c-ll, 7l^^ ^ 71 H 
Sll^H^cr ^-^l^-^l^ tllcl SL aj^S^l cfl*V ^-^o] ^ « C V^ 

^Ml £H f^-S-t!: ^^S7> ^ 71 5 ell^oll m}^ ^7} ^cf. 
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1020010012184 #^ <a^l-: 2001/12/13 

<23> o]^] ^tgofl^fe. til^ ajiEoj) ^sM ^"4 f'-S.iE* Q^*} 

71 ^# « 0 V^-ar ajiEc] f^S* ^E^M alAE £o_^ ai^ 

<24> tilt} 0_o]lAi HfliE 7 } HlclO_ ^EBJol] tflSfl., #7] 

zj-z}-^ bJae c$ol6\] cfl*! 7>^^1» §jiS £L±°\) &7\} , ^7) 

7>#^11- 7ltiVO.S *H 4>7l ^oflAi EjjAEf A1^§>^ ^1, # 

71 ^d^€ ^M*^ *>u|-2l oln]*Hl ^Tl-t- tfljt*>fe 

^il ^ 7l^5ll<y ^.S -g^Kr #7fl; » Ifs}^ cl^ol^l^ ^-g; £^jo 
S Sfrfe- tiltq^. UJ^e ^ 7i n^cy ^wj-^oic]-. 

<25> a*V ^il <W 7>#^» ^ #5} 

^^21 3.71 , Q]^Ei eg <^ ofl ^ Si ^ ^il Ai^l 3.7), ^iS <*}o3 
21 cli#5flol *l^Al#oll *l3l*H W*Rr #31, ^ 7] ^511^^- Cl 

^1"3M C^o^u}- ti.51-^-^21 3 7l ofl oj-^-Til *)7} ^ £<L3_ ^ 

«1^E ol 7 il^ # ^^TlM- ^MS] A>ol^ ^*>^ ^-Tfl, ^-71 ^ 

€ ^l"* <>H *H ^>8*M wlcli^ ifl^Ei ^ 

71 sell 0 J^S rils^ #7115. ol =lo1^ 5)^- s^joi ^ ej^H ^ 71 5. 
5)1 <y ^olcf. 
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1020010012184 %^ <£x}: 2001/12/13 

^ o^cf. 5L2^ ^ 7lSEfl<y^ 0]^-^- aju]^ *5}-^ 

^S^* ti^^l^>7l * (TOO 1)^*1 Ol-g-ol 7^5:>Cf 

< 27 > 5L3^- ^ 7l Sefl^ 7fl^* iL°^tf. 

-S-dti^ ^-i: cflS^>7l $\*\c$ 7) 5. Ell <y (key frame)* ^#S>31, °]« 3^ 

71 Sell*} ^# «J-^ol ^sl^tf. ^ 71 Sell<y ^# « 0 >^-8: al^^H i, 
^3 ^ ^ #33 4MM 71 Sefl^* ^#<5>ji 71 5. 

Tfl oi^i^- ^ oiji, ^s>i=. ml- e.711 91t\) 

^ ^iL-fr M*Hr ^.S. ^ oic}. ol 7l#^l rcfs^ a]^ 

14-2.^ ^^^^1 A>zl-^(MBR) ^#*r°3 A>-g-7>H7ll tilc]_£2l 

^fl-g-* <M SfoV^- - oljl, ojcj]^ ^ - ol^ 71^-g; ^*lt}. IE*V ^-<£^ 
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1020010012184 ^ ^7}: 2001/12/13 

<30> £4^ til^^. <3^HH EJ l^t U^S} °fl« 

oi> ejAE ^#ofl^ 7>s, 4s <H1*1 M-bJ-M-^- -^1* 

n>^^ S^o] ^JL , tifl^aj. x>7> €■ A>-g-^ <3<*^ «|i 

<32>" H]C]^. ^Eo^ *4^^ Bjil;} f^tb ifl^EO]^ 0>ia*l<2] 

*Htb^ ^ vflofl^ til 4 .2. 3|e| _S.<^Kr al^^. Hfl^S ^ 71 H^l<y ^ 
<£<*sl 37l, ^#=1 ^^xfl^ QJ^MSl j§^- 371, t^#3H 

^ ^l-g-^H ^A£7> ^ ^ 

<34> ^4 <H#^7flol^o.5.^ UMA -§--§- -H^^l^l^l^ol 014. 

<35> A>-g-7>2l ^-'g-^m- A}-g-7} ^^1 ^ M. <£^f>}^ tflEcq^. ^ - 

ofl 44 A>^-47> ol-g-^- - o}^ X^)o]b\6\] is)-^?} ol o. ^ &4. ^_ ^ ^ 44 
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^ ^51 5£*V tflE 

^3. Hj-Aiom ufl^ofl tx\z\ ^^-g-^o] a-^sH 3*fl^ *fl<*» ^ ^> 

Tfloj-^s.^- Universal Multimedia Access Applications (UMA Applications) 

^tbs] ol^fll- ££t ^ 
<37> Ql^-E ^ 71 H5)]<y£- UMA ^S^M-^l 3-§-3°l 

7] ^efl^# 7fl^l- ^]o)B]9] #o]^A-] ^ £)n]*} ^a. 

1- *fl^Rr t^iS o]^-^ ^ clef. 
<38> a. ^jzj- rfs. cH^^Tfloj^o.^.^ al^A JisH-^ 

7\7\ ZL tll^A il^f ^ S.¥ 

# i^] ^Afl^ ^e^>7l ^*flA^ tl]*}^ al ^o. ol-g-^ ^ ol 
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1020010012184 #3 2001/12/13 

<39> £2oflA] #33iM3, TT^ ^-f S.^^. 7 ]AH1 tfl«fl^ ^ vfl-g- 

SEtlr 7]A> tfl-g-^- alAE f 7l t)]-iLS *1|>H x£A£ 7lS5fl<yo] 

olcf. o^H Efl^E ^ 7] a el] oj^- ^ ^i#3H 

1- EJjiE^ iL^i-J7 Olcf. 

<40> ol^^- QJ^E ^ 7ll£^^^- 7l«>o.S. ^#*Kr ^* 

<4i> JE5^ ^ hi^e ^ 71 ^efl^oll cflt!- 7H^# _S.^t!r S^l^. 

aj^S ^ 71 Sefl^^- tilt^olH Qj^E <^^ol ajcl^. ^oii^ 

^ <3<^ ^iLE-I- Tfl^V^ 7>^*1* ^H, 7>^*1 °] a o V ol 71 <g erf 

AflS^ 71 3Lefl<y# ^*Hr 3°1 ^-S- 
<42> 9!iE ^ 7i s e ii<y^ ; ^^sl ^7l(A), 

tfl^l j^o) sg^ £L7l(B), ^iM^l cli#Sflol ^ Al^>(C)l- 51 

<43> ^, I=A*a + B*b + C*c (a + b + c = l) 

<44> <*|7H ( a.b.c^ A iL^CA.B.CHl cfltV 7>#*1 , 7\tA$\ '1' 
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1020010012184 #3 2001/12/13 

<45> <#7}i& *}2} ^o) 7}^?\% ^ ^^2] 2^ A>Zfi§ 

3] 37l(MBR)7> HuL ^#51 <^<* ifl£] ElAE _S_^£] ^5" 3.7)7} 3.31, 

S] c]^3H ^ Al^lo) z}^ 7>^*1« £i>|| ^ "<HH4. 

<46> ^ ^n— — -S-i^l 3§5 3.7}^ }£8°\}*\3)- ^ 

^50% 37} <£ ^ ^7l7> ^"O.^ Zj- e}0] Aj-Ojofl 7 > 

3. ofl^l SI^SZL^ 37)7} 37)) ^*}*) ^ ^ ^ ^ olcf. J£ ^ S ofl*l *] 
r^SZL^i 4 #^1- Afolofl^ £17] 7}- 37]) *}o\^ . tiltfls 

^ vfl4) ^-7} 37)7} 3# 5.8°\}7<] 1- ^ SU^l 7>S ofl^l e)i£a^fi] 

&S.7} }£?)) -g-SSM £U #?_H1 3717]- ^]-7l ^^o. 

t^^7] ^Cf. olSf ^ §]^mZL^o] 37)2\ o]-g-^ i^<g 

<47> n+]=B) ^ Ol^ofl °i^S} ^*fl <3^* «1 

^ *r 5^. 3.71^ ^^l^ii7]- -^A>^>J7 ; ofl*] S]^J= 

n^o] ^o] ^o] 7 > °J 31*1 (threshold) iL^r ¥ ^— H 

3. 0]^^^ r]^ 2 fl o] ^ a]^ ^o]cf. 

<48> fJj^E ^ 71 S31<y£- til^^. iSM ^ *}3L kr?m 

', #33 ^ <T 9l^. ^ SLioflAi i^El-uf ol^o] 

<49> tHll- ti l^-2- S|iSr t^^^e]] o] c]a>ol^o) H7]i4 3ieH-*H'M @) 

— — ^ 71 sefl^s] ^ ^ ofl ttj-e}- 71 Hei]<ya] 7fl^q- ^z}2) a}o)zl7} 

*r ^4. ^, ^#3H *h ^^°1 71^1^ a)A M o] 7l) ^ # fe 
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1020010012184 #^ 2001/12/13 

^ ^1 SLefl^s] 7 fl^ ^^°1M- 4^ i)iE ^ca^ aH^ 51^- 3 

o. A>-g-^>o] (readability)* -HB^M^) 

<50> £6 U A £7^r ^<H1 ^ ^-Aj 71 n^o} uj-Bf^ 

£6^1 ^-fxr Tfi Wlcl^A^ ^ 7lA> ^Vofl tfl*|H ifl^E ^- 

<51> £6 ^ £7o)H Jife ^ ^) ^-^ rt<^ vflo] BjAEo]! tflsfl Z|Z| fl£ 
Ml- 

vfls] Efl^e <^o3.§- s.^. a^^v rl-g-, ^#sl Hj^S ^^^1 cfltb 7>^ 

— cl^#efloi ^I^aI^i tilBfl^H ^Hfca, Ji5R-*1(t^#3H) el 

7H1 ^Tfl 7>#^7> Uj^SS] TJJ^CHL^ AVol^)S- ^A^ 

°1 ^*fl^ 3^r(3^r Afol^)^ ejI^e ^«#* olnl^ofl ®i — 

— ^ 7lS3l<yj°S ZL 7lA>o^ tfl-g-g- f}-^ O.S iL<^^r ^Mcf. 

<53> 5L7^ ^-*Hr & v)t]SL ^•^lSoflA-1 s.^ ^ofl Efl<irH ^iS ^ 

#tb tj~g-, tt^ alcl o.. ^-^lE^ej ^ £ 7 r #*l<4 J±bH-*1^ 

25-15 
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-*^Rr ^ 71 ^ell<y ^# «o Vl 3-a- ^1^ ^ 71 5. 

Efl°J «<H1£: ^iS°l ^Att Sjilt 

^*}7l nfl^-ofl wlcli s^Ef #ci ^^>7ll ^ 9X31 olsfl 
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1020010012184 %^ Qx}: 2001/12/13 
13^% 1] 

*l^_£.olH S|i!7} zj#^ ^e^ofl cflsfl, AA$\ 

AS *H 4>7l S,'iS ^ofl^ UJ^E-g. ^Tfl, ^-71 ^£ 

2] 
3] 

<3<^H cflt!- 7>^^11- Hj^E cg^o] £!7l ; vil^E. 

3g-g- Efl^E £^0] a.7], <£<*<i] ^*ElH ^1 #A] #ofl Hi^l^>oi ^ 
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[^^J- 4] 

^ 3 %H1 , ^7l cg<*o} H7l ^ til^l^ Efl^M c^crf^ ^ 

31 °J ^# 
5] 

*fl 3 *<H] ^-71 cga^^o} jg^. ei^E j^cq ^ 7 )^ ^ 

#^ ^j^E uHH °fl^l(Edge)^ 7>S, ^ls ^I^s^l^^i ^£^1- 3.71 ^ 

^ ^it 7Mji ^<*^ Qi^Eol 3711- ^ ^ al^l 

SL ^iE ^ 71 £5)1^ ^# « 0 >^. 

6] 

3 %H1 ^7) ajil ^<^2l tl^efloi *]^Al7Kg- ol^ofl ^ 

^ <^o^ ^ ej^m <3^£l ##sH ^ 

7i ^3i<y ^# 

7] 

3 %H1 5d<>H, #71 7}^*} ol#o^ EJJ^E cg^o. AjEfl^ ^ 

^ ^JiS cgc^o} 3.71M-, ^#S} Hj^E ifloj eJI^eo^ 3g^- a.7l 
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^^l c^#3M *1*HI «lsfl*H 7>^^1* ^o]^ ^-g- s. 
E J)iI ^ ?1 Sefl«y ^# « 0 >^. 

[^t 1 * 8] 
9] 

£}^#5lH^ c]w>ol^uf ue}-^^^ S7loll Hl^^H ^^7i 14 3^: 
10] 

^1 l ^cHl 5a<>H, ^-71 Qj^Eoi A>oi^i- ai^E ^ ^^eil^^; 
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